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Abstract 

It is well-known that the traditional Chinese remainder theorem (CRT) is not robust in the sense that a small 
error in a remainder may cause a large error in the reconstruction solution. A robust CRT was recently proposed 
for a special case when the greatest common divisor (gcd) of all the moduli is more than 1 and the remaining 
integers factorized by the gcd of all the moduli are co-prime. In this special case, a closed-form reconstruction 
' from erroneous remainders was proposed and a necessary and sufficient condition on the remainder errors was 

, obtained. It basically says that the reconstruction error is upper bounded by the remainder error level t if r is 

smaller than a quarter of the gcd of all the moduli. In this paper, we consider the robust reconstruction problem 
CO ■ for a general set of moduli. We first present a necessary and sufficient condition for the remainder errors for a 

robust reconstruction from erroneous remainders with a general set of muduli and also a corresponding robust 
reconstruction method. This can be thought of as a single stage robust CRT. We then propose a two-stage robust 
^ , CRT by grouping the moduli into several groups as follows. First, the single stage robust CRT is applied to each 

^ group. Then, with these robust reconstructions from all the groups, the single stage robust CRT is applied again 

across the groups. This is then easily generalized to multi-stage robust CRT. Interestingly, with this two-stage 
robust CRT, the robust reconstruction holds even when the remainder error level r is above the quarter of the 
, gcd of all the moduli. In this paper, we also propose an algorithm on how to group a set of moduli for a better 

CO ■ reconstruction robustness of the two-stage robust CRT in some special cases 

rn 
O 

' Index Terms 



X 
J3 



Chinese remainder theorem, robustness, frequency estimation from undersamplings, greatest common divisor, 
moduli 

I. Introduction 

The problem of reconstructing a large integer from its several remainders modulo several smaller positive 
integers (called moduli) may occur in many applications, such as phase unwrapping in radar signal processing lITOl . 
|[T4l - |[23l and frequency determination from several undersampled waveforms lEl, ||9]- The traditional solution 
for this problem is the Chinese remainder theorem (CRT), see for example, |[l]^ ll2l^ that uniquely formulates the 
solution from the remainders if all the moduli are co-prime and the large integer is less than the product of all 
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the moduli. When the moduU are not co-prime, the large integer can be uniquely determined if it is less than 
the least common multiple (1cm) of all the moduli O, lH, where one may also find the reconstruction methods. 
However, it is well-known that the above solution is not robust in the sense that a small error in a remainder 
may cause a large error in the reconstruction solution, which may degrade the performance of its apphcations 
in phase unwrapping and frequency determination, since in these applications, signals are usually noisy and the 
detected remainders may be erroneous. For the robustness, there have been several studies recently lITTI - llTJl . 
Robust reconstructions from erroneous remainders were recently proposed in |[T2l . |[T3l for a special case when 
the greatest common divisor (gcd) of all the moduli is more than 1 and the remaining integers factorized by the 
gcd of all the moduli are co-prime. In this special case, a closed-form reconstruction from erroneous remainders 
was proposed in ||T3l and a necessary and sufficient condition on the remainder errors was also obtained in ||T3l . 
It basically says that the reconstruction error is upper bounded by the remainder error level r if r is smaller 
than a quarter of the gcd of all the moduli |[T2l . A special version of this result was obtained earlier in lITOl . 
In some applications, an unknown, such as the phase unwrapping and frequency estimation, is real valued in 
general. So, in |[T3l the closed-form robust CRT algorithm was naturally generalized to real numbers. Also, a 
lattice based method was proposed in ll25l to address the problem of estimating a real unknown distance with 
a closed-form algorithm using phase measurements taken at multiple co-prime wavelengths. One can see that 
there are constraints on the moduli in previous works. The constraints on the moduli may, however, limit the 
robustness when the range (called dynamic range) of the determinable integers is roughly fixed. 

Different from robustly reconstructing the large integer from its erroneous remainders, another existing ap- 
proach is to accurately determine the large integer by using some of the error-free remainders among all the 
remainders ||5l, ||6], Q, which may require that significantly many remainders are error-free and a large number 
of moduli/remainders may be needed. This approach may sacrifice the dynamic range for a given set of moduli (or 
undersampling rates ||9l) and furthermore, in some signal processing applications, to obtain error-free remainders 
may not be even possible, because observed signals are usually noisy. A probabilistic approach to deal with 
noises in CRT was proposed in 17], where all the moduli are required to be primes. 

In this paper, we consider the robust reconstruction problem for a general set of moduli on which the constraint 
used in |[T2l . |[T3l is no longer required. We first present a necessary and sufficient condition for the remainder 
errors for a robust reconstruction from erroneous remainders with a general set of muduli, where a reconstruction 
method is also proposed. This can be thought of as a single stage robust CRT. We then propose a two-stage 
robust CRT by grouping the moduli into several smaller groups as follows. First, the robust single stage CRT is 
applied to each group. Then, with these robust reconstructions from all the groups, the robust single stage CRT 
is applied again across the groups. Interestingly, with this two-stage robust CRT, the robust reconstruction holds 
even when the remainder error level r is above the quarter of the gcd of all the moduli. The two-stage robust 
CRT is then easily generalized to multi-stage robust CRT. In this paper, we also propose an algorithm on how to 
group a set of moduli for the better reconstruction robustness of the two-stage robust CRT in some special cases. 

Note that the two-stage robust CRT is first appeared in Il24l that is, however, based on the special single stage 
robust CRT in llT3l when the remaining factors of all the moduli after factorizing out their gcd are co-prime. 
With the two-stage robust CRT obtained in ll24l . the remainder error level r is, in fact, not better than the quarter 
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of the gcd of all the moduli. In contrast, our newly proposed two-stage or multi-stage robust CRT in this paper 
is based on the generalized single stage robust CRT for arbitrary moduli also newly obtained in this paper and 
as mentioned earlier, the remainder error level r can be above the quarter of the gcd of all the moduli, i.e., it 
achieves a better robustness bound than ll24l does. 

This paper is organized as follows. In Section JIJ we first briefly introduce the robust CRT results obtained 
in |[T2l . |[T3l . We then propose our new single stage robust CRT with the necessary and sufficient condition for 
a general set of moduli. In Section |llll we propose two-stage and multi-stage robust CRT. In Section |IVl we 
propose an algorithm on how to group a set of moduli for a better reconstruction robustness of the two-stage 
robust CRT. In Section |Vj we present some simulation results on estimating integers with a general set of moduh. 
In Section [Vll we conclude this paper. 

II. Single Stage Robust CRT 

Let us first see the robust remaindering problem. Let be a positive integer, < Mi < M2 < • • • < Mi be 
L moduli, and ri, r2, • • • , r/, be the L remainders of N, i.e., 

iV = ri mod Mi or N = UiMi + n, (1) 

where < rj < Mi and rii is an unknown integer, for 1 < i < L. It is not hard to see that N can be uniquely 
reconstructed from its L remainders if and only if < < 1cm (Mi, M2, • • • , Ml). If all the moduli Mi are 
co-prime, then the Chinese Remainder Theorem (CRT) provides a simple reconstruction formula lH], ||2]. 

The problem we are interested in this paper is how to robustly reconstruct when the remainders ri have 
errors: 

< fi < Mi - 1 and jfj - ri\ < r, (2) 

where r is an error level that may be determined by, for example, the signal-to-noise ratio (SNR) and is also 
called remainder error bound. Now we want to reconstruct N from these erroneous remainders fj and the known 
moduli Mi. The basic idea for the robust CRT in the recent studies and also this paper is to accurately determine 
the unknown integers rii in ([T|) which are the folding numbers that may cause large errors in the reconstructions if 
they are erroneous. Therefore, the problem is to correctly determine the folding numbers rij from these erroneous 
remainders fj. 

Once nj for 1 < i < L are correctly found, an estimate of N can be given by 

N{i) = n,M, + n = UiMi + + Ari, for any i, 1 < i < L, (3) 

where Arj = fi — ri denote the errors of the remainders. From (|2), | Arj| < r. Then, an estimate of the unknown 
parameter is the average of N{i): 

L 

L 



N 



1=1 

L 



N + 



L 

i=l 



(4) 



N + Af, 
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where Ar is the average of the remainder errors, and [•] stands for the rounding integer, i.e., for any a; G M (the 
set of all reals), [x] is an integer and subject to 

-^<x-[x]<^. (5) 

Clearly in this way the error of the above estimate of N is upper bounded by 

|iV - iV| < r, (6) 

i.e., iV is a robust estimate of N. 

For the above robust remaindering problem, solutions, i.e., robust reconstruction algorithms, have been proposed 
in ifTll . |[T3l for a special case when the gcd of all the moduli is more than 1 and the remaining integers factorized 
by the gcd of all the moduli are co-prime. The main results can be briefly described below. 

Let AI be the gcd of all the moduli Mj in ([T]). Then Mi = MFj, I < i < L, and assume that all Tj for 
1 < i < L are co-prime, i.e., the gcd of any pair Fi and Tj for i ^ j is 1. Define F = rir2 • • • Tl. For 1 < i < L, 
let 

7i = Fi • • -ri^irj+i • • • Fl = r/r,, (7) 

where 71 = F2 • • • F^ and 7l = Fi • • • Fl_i. We now show how to accurately determine the folding numbers JZj 
in |[T2l and |[T3l . respectively. First, define 



Si = \ (ni,ni) = argmin^i^=o,i,-,7i-il"-i^i + U - fiiMi -ri\\- (8) 

^ n,=0,l,- - ,7,-1 

Let Si^i denote the set of all the first components ni of the pairs (ni,nj) in set Si, i.e., 

— {ni|(ni,ni) G Si for some nj} (9) 

and define 

L 

S=\^S^,l. (10) 
i=2 

It is proved in lfT2l that if the remainder error bound r is smaller than a quarter of M, i.e., r < M/4, the folding 
numbers rij for 1 < i < L can be accurately determined from 5 and Si. Set 5 defined above contains only 
one element ni, and furthermore if (ni,ni) E Si, then fa = rii. In addition, [12] has proposed a 1-D searching 
method with the order of 2{L — l)Fj searches. When L or Fj gets large, the searching complexity is still high. 
Then, a closed-form robust CRT algorithm and its necessary and sufficient condition for it to hold have been 
proposed in |[T3l . For the closed-form algorithm, we refer the reader to |[T3l with which the following necessary 
and sufficient condition for the accurate determination of the folding numbers rii is obtained in |[T3l . 
Proposition 1: |[T3l Assume that all Fj, for 1 < i < L are co-prime and 

< iV < lcm(Mi,M2,--- ,Ml) = MFiF2---Fl. (11) 

Then, with the closed-form algorithm determining for 1 < i < L in lfT3l . n, = for 1 < i < L, i.e., the 
folding numbers for 1 < i < L can be accurately determined, if and only if 

- M/2 < Ari - Ari < M/2, for all 2 < i < L. (12) 
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Although the condition (fT2l) in Proposition [T] is necessary and sufficient for the uniqueness of the solution of 
the folding numbers Ui, it involves with two remainder errors and is hard to check in practice. However, with this 
result the following proposition becomes obvious, which coincides with the much simpler sufficient condition in 

m. 

Proposition 2: |[T2l . |[T3l Assume that all Fj for 1 < i < L are co-prime and 

< iV < 1cm (Ml, M2, ■■■ ,Ml) = MriFs ■■■Tl. (13) 
If the remainder error bound r satisfies 

r < M/4, (14) 

then we have hi = rii for 1 < i < L, i.e., the folding numbers nj for 1 < f < L can be accurately determined. 

As it was mentioned earlier, these robust reconstruction results are based on the assumption that the gcd M 
of all the moduli is more than 1 and the remaining integers Tj in the moduli Mj factorized by their gcd M are 
co-prime. For example. Mi = 5 • 5 = 25, M2 = 5 • 7 = 35, M3 = 5 • 16 = 80, and M4 = 5 • 19 = 95, where 
M = 5. When the remainder error level r < 5/4, any integer less than 5 • 5 • 7 • 16 • 19 can be reconstructed within 
the same error level as the remainders from the erroneous remainders by using the algorithms in |[T2| . |[T3l . A 
natural question is what will happen if a general set of moduli Mi are used. For example, what will happen if 
Ml = 5 ■ 14 = 70, M2 = 5 • 15 = 75, M3 = 5 • 16 = 80, and M4 = 5 • 18 = 90? First of all, their gcd is M = 5 
and if we divide them by their gcd, we get Fi = 14, F2 = 15, F3 = 16, and F4 = 18 and clearly these four 
Fj are not co-prime. So, we can not apply the algorithms or results in |[T2ll . |fT3l directly, which may limit the 
applications in practice. 

We next propose an accurate determination algorithm for the folding numbers rii from erroneous remainders 
for a general set of moduli Mi with a new necessary and sufficient condition on the remainder errors. Let us 
first see an algorithm for nj. 

Following the algorithm in |[T3l . we can generalize the results as follows. First, from ^ we can equivalently 
write it as the following system of congruences: 

N = niMi + ri 
N = n2M2 + r2 



< 



(15) 



N = ulMl + tl. 

We want to determine nj for 1 < i < L. To do so, we let the last L — 1 equations in ( fTSl) subtract the first one 



and we then have 



Next, denote 



niMi — n2M2 = ^2 — ri 

niMi — nsMs = r-^ — ri ^^^^ 
niMi - ulMl = rL-ri. 



mii = gcd (Ml, Mi) , Tii = , F^ = , and qn = 

mii mii mii 
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Then, we can equivalently express equation ([T6] l again as 

niTi2 - n2T2i = q2i 

niTiL - ulTli = QLi- 
Since Fu and Fn are co-prime, by Bezout's lemma (Lemma 1 in |[T3l ) we get 



(17) 



ni = qnTi + kqiiFii 
<?.i(r.ri.-i) 



(18) 



Til 



+ kquFii, 



where l<i<L, kGZ (the set of integers) and Fi is the modular multiplicative inverse of Fu modulo Fn. 
We can use 



qn 



n 



mii 



+ 



Arj — Ari 



(19) 



as an estimate of qn for 2 < i < L. Recall that [•] stands for the rounding integer which is defined in (l5). Let 
rij for 1 < i < L be a set of solutions of (fTTl ) when qn is replaced by qn for 2 < i < L. In summary, we have 
the following algorithm. 



Step 1: Calculate these values of mu = gcd (Mi, Mj), Ti, = ^ and Tji = ^ for 2 < i < L from the 
given moduli Mj for I < j < L, which can be done in advance. 

Step 2: Calculate qn for 2 < i < L in ( fT9l ) from the given erroneous remainders fj for 1 < i < L. 
Step 3: Calculate the remainders of quFi modulo Fu, i.e.. 



= quFi mod Fii 



(20) 



for 2 < i < L, where Fi is the modular multiplicative inverse of Fu modulo Fu and can be calculated in 
advance. 

Step 4: Calculate hi from the following system of congruences: 



hi = ^ii mod Fii, for 2 < i < L, 



(21) 



where moduli Fu may not be co-prime, which can be done by using the algorithms in, for example, ||3], 
Bl . and in H, a multi-level decoding technique to reconstruct the large integer is proposed. 
• Step 5: Calculate for 2 < i < L: 

hiFu - qa 

ni = . (22) 



i ii 

With the above algorithm, we have the following necessary and sufficient condition result for a general set of 
moduli. 

Theorem 1: Let Mj, 1 < i < L, be L arbitrarily distinct positive integers as a given set of moduli and 
< < 1cm (Ml, M2, • • • , Ml). Then, hi = rii for all 1 < i < L, i.e., the folding numbers for 1 < i < L 
can be accurately determined, if and only if 



gcd (Ml, Mi) /2 < Ar./ - Ari < gcd (Mi, Mj) /2, for all 2<i<L. 



(23) 
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Proof: We first prove the sufficiency. Considering the condition in (l23l) and the estimate of qn in ( [T9l ). from 
^ for the definition of the operator [•] we have qn = qn. Then, from equation ([TST l. ni and gaTi have the same 
remainder modulo r,;i. Since qn, Fj and Tn are known, we can calculate qnTi = mod Tn. Thus, ni = 
^ii mod Til for 2 < i < L, which form a system of simultaneous congruences as hi = mod Tn. In addition, 
since niMi < N <lcm(Mi, M2, • • • , Ml), it is not hard to see that ni is less than 1cm (r2i, Tai, • • • ,Tli). So, 
according to the algorithm about generalized CRT in |]4], ni can be uniquely reconstructed by solving the above 
system, and ni = hi. 

After ni is determined, we can obtain other integers Ui for 2 < i < L from equations (ITtI ) or ([TST l. Therefore, 
hi = Ui for 2 < i < L. Hence, the sufficiency is proved. 

We next prove the necessity. Assume that there exists at least one remainder that does not satisfy (|23T i. For 
example, the j-th remainder fj, 2 < j < L, does not satisfy ( [231 ). This equivalently leads to [(Ar^ — Ari) /rriij] ^ 
and therefore qji ^ qji. We then have the following two cases. 

Case A: When [{Arj — Ari) /mij] ^ kTji for any k ^ Z. We want to prove that the remainders of qjiTj and 
qjiTj modulo Fji are different. Assume qjiTj and qjiTj have the same remainder modulo F^i, i.e., 

qjiTj — qjiTj = kFji, for some A; € Z. (24) 

Multiplying both sides of (l24l ) by Fij and considering Fi^Fj = 1 + kVji for some A; G Z, we have 

qji — qji = kVji, for some G Z. (25) 

According to ([T9l ). we have 

[{Arj - Ari) /mij] = kVji, for some fc G Z. (26) 

This contradicts with the assumption. Hence, the remainders of qjiTj and qjiTj modulo Fji are different, i.e., 
ni and hi have different congruences. Thus, ni ^ hi. 

Case B: For every 2 < i < L, [{Avi — Ari) /m-u] = ^r^i for some k £ Z but there exists at least one j with 
2 < j < L such that [{Arj — Ari) /"^ij] / 0, i.e., qji / qji. From equation ([T9l ). we have (^jiFj = giiTj mod Fji 
for 2 < i < L. Hence, from the first equation in ([T8] l and according to the generalized CRT, ni can be uniquely 
reconstructed. Thus, from Steps 1-4 in the above algorithm, we have hi = ni. 

However, since qji ^ qji, from equations ([TT] ) or the second equation in (ITST i we have nj / hj. This proves 
the necessity. ■ 

The above result involves with two remainder errors and is hard to check in practice. Let r be the maximal 
remainder eixor level, i.e., |Arj| = |ri — rj| < r, for 1 < i < L. Similar to Proposition |2j we can also present a 
simpler sufficient condition. 

Corollary 1: Let Mi, I < i < L, he L arbitrarily distinct positive integers as a given set of moduli and 
< < 1cm (Ml, M2, • • • , Ml). If the remainder error bound r satisfies 

. gcd (M,,M,) 

T < max mm , (2/) 

l<i<Ll<jj^i<L 4 

then, we have hi = Ui for all 1 < i < L, i.e., the folding numbers 7ii for 1 < i < L can be accurately determined. 
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Proof: Recall that in the procedure of proving Theorem [T] we just arbitrarily selected the first equation in (ITSb 
to be a reference to be subtracted from the other equations to get (fT6l) . In fact, to improve the robustness through 
selecting a proper reference equation to differentiate, we can choose the index i such that mingcd (Mj, Mj) > 
min gcd (M; , Mj ) for / / i. Without loss of generality, modulus Mi satisfies 

3 

. gcd(Mi,Mj) . gcd(Mi,Mj) 

max mm — = mm 



i<i<L i<j^i<L 4 i<jyi<i 4 

Then, we have r < gcd(Mi,Mj)/4 for i / 1. Since r is the maximal remainder error level, i.e., |Arj| = 
l^j — rj| < T, for 1 < i < L, we can obtain 

\Ari - Aril < gcd (Mi, Mj) /2, for 2 < i < L. (28) 

Clearly, equation (|28T l implies the sufficient condition (|23] ) in Theorem [T] Hence, hi = for all 1 < i < L. 
Therefore, we complete the proof. ■ 

Remark 1: Since in the above new result, there is no any constraint to the moduli Mj for 1 < i < L, some 
of the moduli may be redundant with respect to the range < < 1cm (Mi, M2, • • • , Ml) of the determinable 
unknown integer N. The first case is when there exist a pair of moduli Mi^ and Mi^ such that Mj^ = riMi^ 
for n G N (the set of all positive integers) and in this case Mj^ is redundant for the determinable range of N, 
i.e., the 1cm of all Mj. The other case is when there exists one moduli Mj, that is a factor of some other (more 
than one) moduli's 1cm, i.e., 1cm (Mj^, Mj^, • • • , Mj^ ) = nMjg for some n G N and k > A, and in this case Mjg 
is redundant similarly. When a determinable range of N is fixed, we can add or delete some of the redundant 
moduli to or from the moduli set in order to get a better robustness bound for r. For example, the redundant 
modulus 30 in moduli set {20, 45, 30} improves the robustness bound compared with the robustness bound of 
moduU set {20,45} from 5/4 to 10/4. On the other hand, the redundant modulus 10 in {10,45,30} with its 
robustness bound 10/4 does not help but worsens the robustness bound compared with 15/4 of {45,30}, so it 
is better to delete the modulus 10 from the moduli set. Below is a general result. 

Corollary 2: If there exist a pair of moduli Mj^ and Mj^ such that Mi^ = nMi^ for n G N, then, the redundant 

modulus Mj2 does not help to increase the robustness bound and it can be deleted from the set of moduli. 

Proof: Without loss of generality, we can assume for a moduli set {Mi, M2, • • • ,Ml} that gcd(Afi, Af2) > 

gcd(Mi, Afa) > • • • > gcd(Mi, Ml) and the robustness bound is 

. gcd(Mj,Mj) gcd(Mi,ML) 
max mm — = . 

l<i<Ll<jj^i<L 4 4 

Consider another set of moduli {Mi,M2,-- - ,Ml,Ml+i} where Ml+i is a factor of one moduli Mq in 
{A/i, A/2, • • • ,Ml}, i.e., Mq = hMl+i for n G N, 1 < g < L. For the moduU {Mi, M2, • • • , M^, Af^+i}, its 
robustness bound is 

gcd(Mj,Mj) 
max mm — . 

l<i<L+l l<j^i<L+l 4 

To calculate it, we split 1 < i < L + 1 into two parts: I < i < L and i = L + 1. And, 

gcd(Mj,Mj) , . gcd (Mj,Mj) . gcd(ML+i,Mj). 
max mm — = max] max mm — , mm — \ . 

l<i<L+ll<j=ii<L+l 4 i<i<Ll<j^i<L+l 4 l<j<L 4 
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As for A, since 



gcd {Mi, Mj) . gcd {Mi, Mj 

mm ■ — < mm 



we have 



As for B, since 



we have 



l<j^i<L+l 4 i<j7^i<L 4 

l<i<L l<i<L 

,^ . gcd {Mi, Mj) gcd(Mi,ML) 
A < max mm — = . 

l<i<L l<jf^i<L 4 4 

gcd{ML+i,Mj) < gcd{Mg,Mj) for I < j < L, 

. gcd{ML+i,Mj) . gcd {Mi, Mj) gcd{Mi, Ml) 

B < mm ■ — < max mm — 



l<jjtq<L 4 l<i<Ll<jj^i<L 4 4 

Thus, we can derive 

gcd {Mi, Mj) SA ux^ ■ Ecd{Mi,M,) gcd(Mi,M^) 
max mm — = max\A,Bl < max mm — = . 

l<i<L+ll<jj^i<L+l 4 l<i<Ll<jj^i<L 4 4 

This tells us that the redundant modulus M^+i does not help to increase the robustness bound of the set of 
moduU {Ml, M2, • • • ,Ml, Ml+i} compared with that of {Mi, M2, • • • , Ml}. ■ 

From the result of Corollary for a set of moduli, we can delete this kind of redundant modulus Mj^ when 
there exists one modulus Mi^ in the moduli set such that A/j^ = nMi^. So, throughout this paper, a set of moduli 
we consider does not include such a pair of moduli in a single stage robust CRT. 

From the above results, one can see that the choice of the reference remainder is important in determining the 
maximal possible robustness bound for r when the whole moduli set of L arbitrary moduli is considered once 
as above. In fact, when the moduli satisfy the constraint, i.e., Tj are co-prime, in Proposition |2] in lITll . |[T3l . it 
has been pointed out and analyzed in ifTSl that a proper reference remainder indeed plays an important role in 
improving the performance in practice. 

Going back to the necessary and sufficient condition (l23T l. one can see that the remainder error difference 

bound depends on gcd(Mi,Mj), that varies with each Mj, and the choice of the reference modulus Mi. This 

means that for the robust reconstruction of N, the error levels of its remainders fj for different i may have 

different requirements. Also, as it was mentioned earlier, using Mi as the reference modulus is not necessary. 

Let us choose the reference modulus M^ that satisfies 

. gcd (Mfc,M,) . gcd (M„M,) 
mm — = max mm —, (29) 

i<j¥=k<L 4 l<i<Ll<jj^i<L 4 

and the remainder error bound for the reference remainder satisfy 

lA I r 1^ / • gcd (Mfc,Mj) 

Ari. = Iru — ru\ < Tk < mm —. (30) 

Then, we have the following result. 

Corollary 3: Let Mj, 1 < i < L, be L arbitrarily distinct positive integers as a given set of moduli and 

< < 1cm (Ml, M2, • • • , Ml), define the remainder error bound for rj as r^, i.e., \Ari\ = |rj — rj| < Tj for 

1 < i < L, and the reference modulus and its corresponding remainder error bound are M^ and satisfying 
( |29l ) and (l30l) above for some k with 1 < < L. If the remainder error bound Tj, I < i k < L, satisfies 

|. I l~ |. ^ gcd(Mfc,Mj) . gcd (Mfc,M,) 

Arj = rj - Tj < Tj < mm (31) 

2 i<j¥=k<L 4 
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then, we have hi = rii for all 1 < i < L, i.e., the folding numbers Ui for 1 < i < L can be accurately determined. 

Proof: If the reference modulus and its corresponding remainder error bound are and t^, 1 < k < L, we 
just need to prove |Arj — Ar^j < gcd(Afj, Mfc)/2 for all 1 < i 7^ /c < L, which implies the sufficient condition 
(1231 ) in Theorem [2 

Since|Ar,|<r,<g^%^- min S^^iMi), we have 

lA AI<-IAI,IAI^ , ^ gcd (Mfc,MO 

|Ari - Arfcl < |Ari| + |Arfc| < Tj + < ^ . (32) 

Thus, Corollary |3] is proved. ■ 
Next, we consider the example mentioned before again. 

Example 1: Let Mi = 5 • 14 = 70, M2 = 5 • 15 = 75, M3 = 5 • 16 = 80, and M4 = 5 • 18 = 90. It is easy to 
see that their gcd is M = 5, and {Mj}j=i 2,3,4 do not satisfy the constraint of Propositions [T] and |2] in |[T2l . |[T3l . 
Thus, their results can not be applied here. However, from the result of Corollary [T] we can obtain the maximal 
robustness bound r for all remainders as 10/4, which is even larger than 5/4, a quarter of the gcd of all the 
moduli. From the result of Corollary |3] we choose M4 as the reference modulus that does satisfy (|29] l. and we 
can get the robustness bound for each remainder as follows: ri < 10/4, T2 < 20/4, T3 < 10/4 and T4 < 10/4. 
One can see that, if we treat remainder error bounds individually as above, the remainder error bounds for some 
of the individual remainders, such as the second remainder in this example, may be larger than that in (|27| | in 
Corollary [T]for all the remainder error levels. In addition, the robust reconstruction range of is also < < 
lcm(Mi,M2,M3,M4). 

It is clear that when moduli Tn for 2 < i < L are co-prime similar to the case of |[T3l . from the system of 
congruences (1211 in Step 4 in the above algorithm, a closed-form single stage CRT can be obtained as [13] and 
we can replace Step 4 with the following Step 4*. 

• Step 4*: Calculate hi. 

L 

El 
CiihiT^ mod 7, (33) 

where bn is the modular multiphcative inverse of "f/Tn modulo Tn, which can be calculated in advance, and 
7 = r2ir3i • • • r^i. After that, from (|22] | we can get the formulas for other for 2 < i < L. 

Next, let us consider the result in ll24l . If we consider the following special case of moduli in Corollary |3] we 
can obtain a better result of the remainder error bounds than that in p24^. Let a set of moduli be 

{Mi,M2,--- ,ML,+Lj = {Mri,i,Mri,2,--- ,Mri,L,,MM'r2,i,MM'r2,2,--- ,MM'r2,Lj, 

where Li > 2. Then, we have the following corollary. 

Corollary 4: Assume that all the Fj^i, 1 < i < Lj, j = 1, 2, are pair-wisely co-prime, let Fi,! = ri,iM , where 
Ti,! is an integer, and < < lcm(Mi, M2, • • • , Ml^^l^). Denote as the error bound for each remainder 
rj for 1 < i < Li + L2. If 

I An I <Ti < M/4, 
\Ari\ <Ti < M/4, for all 2 < i < Li, (34) 
\Ari\ <Ti < mm' /2 - M/A, for all Li + 1 < i < Li + L2, 
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then with a closed-form algorithm we have nj = for 1 < i < Li + L2, i.e., the folding numbers rij for 
1 < i < Li + L2 can be accurately determined. 
Proof: Since 

gcd(Mi,Mj) . gcd(Mi,Mj) 

mm — = max mm 



l<j<Li+L^ 4 l<j<Li+L2 l<jV«<ii+i2 4 

we can set Mi as the reference modulus and the error bound ti < min gcd(Afi,Mj) _ m (|30l) . 

l<j<Li+L2 ^ ^ 

Then, from dSB when 2 < i < Li, < Af/2 - M/4 = M/4; and when Li + 1 < i < Li + L2, < 
mm' /2 — M/4. So we can accurately determine the folding numbers for 1 < i < Li + L2. Next, we can get 
Til = gcd(M' M ) ~ ^^'^ 2 < i < Li and Tn = T2^i for Li + 1 < i < Li + L2, all of which are co-prime. 
Thus, we can obtain a simple closed-form reconstruction formula for fii similar to (|33] | and then fii by (l22l ) for 
2 < i < Li + L2. ■ 

Example 2: In the above, let M = 10, M = 3, Fi i = 33, ri 2 = 31,r2,i = 35,r2,2 = 37, and the moduli 
are {Mi, M2, M3, M4} = {10 • 33, 10 • 31, 30 • 35, 30 • 37}. From Corollary i] we can get n < 10/4, T2 < 10/4, 
T3 < 50/4, r4 < 50/4. In addition, it has a closed-form algorithm to robustly reconstruct an unknown integer A'' 
for < < lcm(Mi, M2, M3, M4). However, according to the result of |]24l. the remainder error bounds would 
be Ti < 10/4, T2 < 10/4, rs < 30/4, < 30/4. 

Interestingly, the robustness bound result in this corollary is even better than that obtained in Il24l using a 
two-stage robust CRT. What the result here tells us that for the set of moduli in Corollary |4l which is the set 
considered in ll24l . it is not necessary to use a two-stage robust CRT as what is done in 1241 . Another remark 
we make here is that the notation Ti above denotes the ith remainder error bound. Later, without causing any 
notational confusion, tj will denote the remainder error bound for the remainders in the j-th group. 

III. Multi-Stage Robust CRT 

From the study in the previous section, one can see that the robustness bound is kind of dependent on the 
gcd of the moduli. The larger the gcd is, the better the robustness bound is. However, the large gcd reduces the 
1cm of the moduli, i.e., reduces the determinable range of the unknown integer A^. When a set of moduli are 
given, the maximal determinable range is given too, which is their 1cm. Then, the question is for a given set 
of moduli, can we improve the robustness bound obtained in Corollary [T]? Note that in the single stage robust 
CRT obtained in the previous section, all the remainders and their related system of congruence equations are 
considered and solved together simultaneously. A natural question is: can we split the set of moduli into several 
groups so that the moduli in each group have a large gcd and remainders and their corresponding system of 
congruence equations in each group are considered and solved independently using the single stage robust CRT 
obtained in the previous section? If so, can we obtain a better robustness bound than that in Corollary [T]for the 
single stage robust CRT? To answer these questions, let us first see an example. 

Suppose that a set of moduli {180,220,486,513} are given and the gcd of these 4 moduli is 1. These four 
moduli can be split to two groups {180,220} and {486,513}. The gcd of the two moduli in the first group is 
M = 20 with Fi = 180/20 = 9, F2 = 220/20 = 11, and the gcd of the two moduU in the second group is M = 27 
with Fi = 486/27 = 18, F2 = 513/27 = 19. One can see that each group satisfies the condition in Propositions [1] 



11 



and H] and therefore the closed-form robust CRT in llT3l or the single stage robust CRT in the previous section can 
be applied for the robust reconstruction of an unknown integer N with robustness bound r < 20/4 or r < 27/4, 
if TV < lcm{180, 220} = 1980 = qi = 18 ■ 110 or iV < lcm{486, 513} = 9234 = ^2 = 18 • 513, respectively. 

Using the first group with moduli Mi = 180 and M2 = 220 and two remainders ri and r2, if the integer 
is in the range of [0,lcm(Mi, M2)), then N can be uniquely determined by its two error free remainders ri and 
r2 as A'^i with < A'^i < gi; otherwise 

N = Ni mod qi. (35) 

Using two erroneous remainders fi and r2 with error level r, and the closed-form robust CRT in |[T3l or the 
single stage robust CRT in the previous section for the first group, we can obtain an integer Ni and 

if r < gcd(Mi, M2)/4 = 20/4, then |iVi - iVi| < r. (36) 

Similarly, using the second group with moduli M3 = 486 and M4 = 513 and two remainders and r^, if 
the integer N is in the range of [0, lcm(M3, M4)), then N can be uniquely determined by its two error free 
remainders and r4 as A''2 with < A''2 < ^2; otherwise 

N = N2 mod q2. (37) 

Using two erroneous remainders fs and with error level r, and the closed-form robust CRT in |[T3l or the 
single stage robust CRT in the previous section for the second group, we can obtain an integer N2 and 

if r < gcd(M3, M4)/4 = 27/4, then |iV2 - N2\ < t. (38) 

On the other hand, if integer N is in the range of [0, lcm(Afi, M2, M3, M4)) = [0, lcm(qi,g2))> it can 
be uniquely determined by its four error free remainders ri,r2,r^,r4. This can be done either from the four 
remainders directly or from the two new remainders A^i and N2 of with two new moduli qi and 52 with 
equations (l35l) and (l37l) . respectively. For the robustness, as we mentioned earlier, the closed-form robust CRT 
and the results in Propositions [T] and |2] can not be applied to the four moduli and the four erroneous remainders 
directly since they do not satisfy the co-prime condition. In addition, according to our single stage robust CRT in 
Theorem [Hand Corollary [Tjobtained in the previous section, its robustness bound would be r < 9/4 (interestingly, 
for the 4 moduli, their gcd is only 1). However, using the above grouping idea, the reconstruction of can be 
done in two stages: the first stage is to reconstruct iVi in 061 ) and iV2 in ( [38] ) from the two groups, respectively; 
the second stage is to reconstruct N from its two possibly erroneous remainders iVi and N2 with two new moduli 
qi and q2. From the second stage, using the known robust CRT again, we obtain 

if T < gcd(gi,g2)/4 = 18/4, then, |iV - iV| < r. (39) 

Thus, we have a robust reconstruction too. In order to keep all inequalities ([36l ). ([38] ) and ( [39] ). one can see that 
with this two-stage approach, the robustness bound on the remainder error level r is 18/4 which is surprisingly 
even better than 9/4 that is the robustness bound in Corollary [T] using the single stage robust CRT for general 
moduli obtained in the previous section. This means that using two or more groups for a set of moduli may 
have a better robustness bound than that using a single group for the whole set of moduli. Clearly, for the better 
robustness, the way to group the moduli or remainders plays a very important role as one can see from the bounds 
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above. Note that the robustness bound r < 9/4 in Corollary [T] for the single stage robust CRT for the moduli set 
{180, 220, 486, 513} is only half of the robustness bound r < 18/4 for the same moduH set {180, 220, 486, 513} 
but with the grouping and the two-stage approach. We next present our results for general cases. First, we consider 
the case of two groups and two stages. 

Let {Mii,Mi2,--- , Ml , M2,i, M2,2, • • • ,-^2,^2} be the whole set of moduli that may not be necessarily 
all distinct. It is split to two groups with Group 1 of Li moduli: < Mi 1 < Mi 2 < • • • < A^i.LiJ and Gruop 
2 of L2 moduli: < M2,i < A/2,2 < • • • < M2,l2- These two groups do not have to be disjoint. Let be a 
positive integer, and ri i,ri 2, • • • ,'^i,Li,'^2,1)'^2,2) ■ ■ ■ )'^2,L2 the corresponding remainders of N, i.e., 



(40) 



where < j < Mj j and Jij j is an unknown integer for 1 < i < Lj, j = 1 or 2. As we know, A'^ can 
be uniquely reconstructed from its Li + L2 remainders if and only if < < lcm(5i,(52), where 5i = 
lcm(Afi.i, Mi^2) • • • , Mi^i J and 62 = lcm(M2,i, M2.2, • • • , M2.L2). The congruence system (|40l ) can be converted 
into the following two-stage congruences. 
For j = 1, 2, and Group j, we can write 



0<Nj < 6j 
l<i< Lj. 



(41) 



Then, the above A'^i and A^2 can be combined to form a new system of congruences: 

N = li6i + iVi 



(42) 



N = I262 + N2 
< < lcm(5i,52). 

When 5i = 62, the two congruence equations are degenerated to a single equation and without loss of generality, 
we assume 5i 7^ 82 here and such a similar degenerated case is not considered either in what follows in this 
paper Replacing A'^i and A^2 in ((42)) by equations (|4T]) . we have 

N = h6i + Ki^iMi^i + ri,i, 1 < i < Li 
N = I262 + K2,iM2,i + r2,i, 1 < i < L2 
0< A^<lcm(5i,(52). 



< 



(43) 



It is not hard to see that 



where 



A^ = lj5j + Kj^iMj, 



M. 



for 1 < i < Lj, j = 1 or 2. Clearly, 



<5, 



n 



7.* 



M, 



+ Kj^i, l<i< Lj, j = 1,2. 
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From the known values of all the moduli {Mj i} and all the erroneous remainders {fj^i}, if we can accurately 
determine Kj^i and Ij, then we can accurately determine nj^. Thus, we propose the following algorithm to 
robustly reconstruct N, called two-stage robust CRT, when the remainders are erroneous. 

• Step 1: Following the single stage robust CRT algorithm of Steps 1-5 in Section JIl calculate Kj^i for 
I < i < Lj in the system of congruence equations (|4TI ) from erroneous remainders {fj} for each j = 1, 2. 

• Step 2: After obtaining Kj^i for I < i < Lj, j = 1,2, calculate the average estimate Nj of Nj for j = 1, 2 
by equations (H) and (01): 



1 



i=l 



(44) 



where [•] stands for the rounding integer 

• Step 3: Treating Ni and N2 as the new erroneous remainders in the system of congruence equations (|42| 
and following the single stage robust CRT algorithm Steps 1-5 in Section |1I] again, we calculate /i and I2. 

• Step 4: Calculate fij^i for 1 < i < Lj and j = 1,2: 



• Step 5: Calculate the average estimate N of the unknown integer N: 



N 



L1 + L2 



i=l 



(45) 



(46) 



where [•] stands for the rounding integer 
Then, we have the following result. For j = 1,2, let tj denote the error level of the remainders rj j in the j-th 
group, i.e., 

lA'^j,*! = — Tj^il < Tj, 



for 1 < i < Lj and 



Let 



max mm 



gcd(Afj-i,Mj-g) 



l<i<Lj l<q^i<Lj 4 
^ ^ gcd {5i,52) 



In the above, when the j-th group has only one modulus M, i, then Gj = and the corresponding 1cm, 6j, 
is just M, 1. 
Theorem 2: If 

I Arj- i| < Tj < mm{Gj, G), for all 1 < z < Lj and j = 1, 2, (47) 

then, we can accurately determine the folding numbers n^ j = n^ j for 1 < f < L^ , j = 1, 2, and the average 
estimate N of the unknown integer N in ( |46l ) satisfies 

LiTi + L2T2 



\N -N\< 

where [•] stands for the rounding integer dS). 



L1 + L2 



(48) 
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Proof: For j = 1, 2, according to Corollary [T] when |Arj j| < Tj < Gj, we can accurately determine Kj^i 
in the systems of congruence equations (|4TI ): 

= i^j- j, for 1 < i < Lj. (49) 
Furthermore, for the average estimates Ni and iV2 in (l44l ) in Step 2 above, we have 

m,\ = \Nj-N^\<Tj, 

which keeps the same error level as the remainders rj^i for 1 < i < Lj, j = 1, 2. 

In the second stage (|42]) . iVi and N2 become the erroneous remainders. To accurately determine li and I2, 



according to Proposition |2] or Corollary [T] the error levels should satisfy ti < G = g^^(^i'^^) ^j^^j T2 < G 



g^^, then 



lj = lj, for j = 1, 2. 



(50) 



Thus, combining with the first stage, we have the condition ri < min(Gi,G) and T2 < min(G2,G) so that 
Kj^i = Kj^i and lj = lj for 1 < i < Lj, j = 1,2. Namely, we have Uj^i = hj.i from (l45T l. 

After we accurately determine the folding numbers j = fij^i for 1 < i < Lj, j = 1, 2, we can get the average 
estimate N in (l46l) of the unknown integer N, i.e.. 



AT 



1 



Li + L2 

N + 



1 



i=l 



Li + Lo 



.1=1 



i=l 



(51) 



From I Arj j| < r, for 1 < i < Lj for j = 1, 2, we can easily obtain 



\N -N\< 



LiTi + L2T2 



(52) 



Li + L2 

Therefore the proof is completed. ■ 
The above results for two groups of moduli can be easily generalized to a general number of groups of moduli 

by using Corollary [T] twice for the two stages of the congruence equations as follows. 

Assume there are s groups of moduli with s > 2. For every 1 < j < s, the elements in the j-th group are 

denoted as < Mj^i < Mj 2 < • • • < Mj^i^, let 6j = 1cm (Mj 1, Mj 2, • • • , -^i.Lj) ^^d Tj denote the error level 

of the remainders rj^i, I < i < Lj, from the moduli in the j-th group, and when the j-th group has more than 

one element, define 

gcd(Mj,i,M,-,) ^^^^ 



Gn = max min 



. Let 



icd{6i,5q) 



If the j-th group has only one element, Mj 1, define Gj 

G = max min 

l<i<s l<q=ii<s 4 

Then, we have the following result. 
Theorem 3: If 

I Arj^il < Tj < mm{Gj,G), for all 1 < i < Lj and I < j < s, 



(54) 



(55) 
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then, we can accurately determine the folding numbers j = j for 1 < i < Lj and I < j < s, thus we can 
robustly reconstruct N as an estimate of N when < < 1cm {61,62, - ■ ■ ,6s)- 

s Lj 



N 

and 



^i=i j=i i=i 



\N -N\< 



(56) 



(57) 



Proof: The proof is similar to the proof of Theorem In the first stage, via (1551 ) we can accurately determine 
the folding numbers Kj i for I < i < Lj, 1 < j < s, and obtain the robust estimates Nj of Nj for the j-th group 
with the error bound \Nj — Nj\ < tj < min(Gj, G), where < A''j < 6j for all I < j < s. 

Then, in the second stage we take these estimates Nj as erroneous remainders and 6j as moduli for 1 < j < s 
to form a new congruence system. Applying the result of Corollary \T\ again, we can accurately determine the 
unknown folding numbers lj for 1 < j < s. By that, we can accurately determine n^- j for 1 < i < Lj with 
1 < J < s- 

Lastly, once we get the accurate values of j, the average estimate N of N can be found. The error bound 
of N is proved similar to Theorem |2] Hence, the theorem is proved. ■ 

Similar to Corollary |3] for the single stage robust CRT, in the second stage with moduli 6j and erroneous 
remainders Nj for 1 < j < s, we can also individually consider the remainder error level for each remainder Nj 
with respect to modulus 6j and have the following result. 

Corollary 5: Assume that the reference modulus is 6k for some k with 1 < A; < s, which satisfies 

. gcd{6k,6q) . gcd {6i,6q) 
G = mm — = max mm — 

^<<l^k<s 4 l<i<sl<q^i<s 4 

and its corresponding remainder error bound < G. If 

I Arfc^il < Tfc < min(Gfc, G), for all 1 < i < L^, (58) 
I Arj- i I < Tj < mm{Gj, g^^^^^''^^) _ mm{Gk,G)), for all 1 < i < and 1 < j / /c < s, (59) 

then we can accurately determine the folding numbers nj j = j for 1 < i < Lj and I < j < s. 

Example 3: Given three groups of moduU: {26 • 5, 26 • 6}, {27 • 7, 27 • 13}, and {28 • 15, 28 • 11}. We can get 
Gi = 26/4, G2 = 27/4, G3 = 28/4 and G = 21/4. So, from Theorem |3] we obtain the robustness bounds: 
n < min(Gi,G) = 21/4, T2 < min(G2,G) = 21/4 and T3 < min(G3,G) = 21/4. If we use the result of 
Corollary |5] we can get a better error bound for some groups as follows: ri < 26/4, T2 < 21/4 and T3 < 21/4. 

For a given set of L moduli Mj, 1 < i < L, there are many different grouping methods of the remainders, 
and therefore, many ways to robustly reconstruct the unknown integer from its erroneous remainders. Let us see 
an example. 

Example 4: Consider the moduU set {Mi, M2, M3, M4} = {48 • 4,48 • 3,56 • 3,56 • 2}. First, consider all 
the moduli as a single group and we obtain the robustness bound 24/4 according to Corollary [T] Second, we 
group the four moduli into two groups {48 • 4,48 • 3} and {56 • 3, 56 • 2} with Gi = 48/4, G2 = 56/4 and 
G = §^^(^1''^'') = 48/4 in Theorem |2] Accordingly, the robustness bound in this case is ri < 48/4 and T2 < 48/4. 
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Lastly, if we group the four moduli into another two groups {48 • 4, 56 • 2} and {48 • 3, 56 • 3} with Gi = 16/4, 
G2 = 24/4 and G = 336/4, then, the robustness bound in this case is ri < 16/4 and T2 < 24/4. 

From this example, we can see that different grouping methods lead to different robustness bounds. Compared 
with the robustness bound by using a single stage robust CRT for the whole set of moduli, sometimes a grouping 
can enlarge the robustness bound while sometimes a grouping may decrease the robustness bound. Thus, another 
question is whether there exists a proper grouping method to ensure the robustness bound larger than that in 
Corollary [T] using the single stage robust CRT. We next present a result that tells us when there exists a grouping 
method with a better robustness bound for remainders in some groups using a two-stage robust CRT than that 
using the single stage robust CRT. 

Corollary 6: For a given set of L moduli {Mi, i = 1, - ■ ■ , L}, the robustness bound can not be enlarged for 
remainders in any group by using a two-stage robust CRT with a grouping method of the moduli if and only if 
it is the case of llT3l . i.e., the remaining factors Tj of the moduli Mj = MTj divided by their gcd M, 1 < i < L, 
are co-prime. 

Proof: It is easy to prove the sufficiency as follows. When the moduli Mi satisfy the constraint in |[T3l . i.e., 
Ti axe co-prime, its robustness bound using the single stage robust CRT with a single group moduli is M/4. On 
the other hand, from Theorem |3] each Gj of any grouping and G are both Af/4. Hence, we cannot enlarge the 
robustness bound in this case. 

We next prove the necessity. Assume that the robustness bound for remainders in any group can not be enlarged 
by the two-stage robust CRT with a grouping method of the moduli over the robustness bound of the single stage 
robust CRT of the whole set of the moduli. Denote gcd (Mj,Mg) = niiq. Without loss of generaUty, we can 
assume 

miL gcd (Ml, Ml) . gcd{Mi,Mg) 
= = max mm , 

4 4 l<'i<L l<qf^i<L 4 

and 

mi2 > 77113 > • • • > miL- 

Thus, according to Corollary [T] its robustness bound using the single stage robust CRT with a single group 
moduli is mij^/4. We then have the following two cases. 
Case I: There exists one q with 2 < q < L such that 

mi2 > ■ > mig > mi(g+i) > • • • > rriiL- 

If we group the moduli as Group 1: {Mi, ■ ■ ■ ,Mq}; and Group 2: {Mi, Mg^i, ■ ■ ■ ,Mi}. With this grouping, 
we have that Gi > mn/A and G2 > mn/A, G > Mi/ A > itiil/A. Thus, we obtain ti < min{Gi,G}, 
T2 < min{G2,G}, where min{Gi,G} > mii/A = r, which contradicts with the assumption that we cannot 
enlarge the robustness bound for the remainders in Group 1 using a two-stage robust CRT. This proves that 
mi2 = mi3 = • • • = miL- 

Case II: Under the condition of mi2 = rrii^ = ■ ■ ■ = mii = M, we know that any m^g = gcd(Mj, Mq) > M, 
since M is a factor of all the moduli Mi. Suppose that there exists one rriiq > M with q ^ i ^ 1. We can 
group the moduli as Group 1: {Mj,Mg}, and Group 2: {Mi, {Mi^}i^^q or i}- Similar to Case I, Gi > M/4, 
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G2 > M/4 and G > Mj/4 > M/4. So, we can enlarge the robustness bound for the remainders in Group 1 by 
using the two-stage robust CRT with this grouping. This also contradicts with the assumption. 

From the above two cases we conclude that rriiq = M for all 1 < i 7^ g < L, i.e., it is the case of |[T3l . ■ 

Now, we give an explicit example. Suppose that there are a set of moduli with the form of {MiKi, M2K1, M2K2, 
M2K3}, where Mi, Ki, K2, K-^ are co-prime. According to Corollary [T] the robustness bound using the sin- 
gle stage robust CRT is r < min (Af2, ^igcd (Mi, 1/2)) /4. If the moduli are grouped into two groups as 
{MiKi, M2K1} and {M2K1, M2K2, M2Ks}. Then, according to Theorem |2l its robustness bound is ti < 
Kigcd{Mi, M2) /4 and T2 < M2/4, one of which is greater than the robustness bound min(M2, Kigcd(Mi, 
M2))/4 when M2 / Kigcd (Mi, M2). 

Example 5: Let Mi = 8, M2 = 14, Ki = 3, K2 = 5, and = 7. Then we can calculate ri < 6/4 and 
T2 < 14/4 from the two-stage robust CRT. One can see that T2 < 14/4 is significantly greater than r < 6/4 
using the single stage robust CRT. 

From Corollary |6] one can see that as long as Fj in moduli Mj are not all co-prime, using a two-stage robust 
CRT with some grouping method has a larger robustness bound for remainders in some groups than the single 
stage robust CRT does. In the same way, we may treat {61,62, ■ ■ ■ , 5^} as a new set of moduli and group it again 
so that the single stage robust CRT is applied three times with the following result. We call it three-stage robust 
CRT. 

Let us split {61,62,- ■■ ,6s} in Theorem |3] to k groups. For every I < t < k, the elements in the t-th group 
are denoted as < 6t,i < ■ ■ ■ < 6t^y^, let = lcm((5t 1, • • • , 5t,yJ and define 

gcd{6t,i,6t,q) 



max mm 



Let 

We then have the following result. 
Theorem 4: If 



T 



max mm 

\<i<k \<qi^i<k 



gCd(ei,^g 



|Arj^j| < Tj < min(Gj, mm{Tt : 6j G {6t.i, ■ ■ ■ , 6t^y^}}, T), for all 1 < i < Lj,l < j < s and I <t < k, 

(60) 

then, we can accurately determine the folding numbers j = n^.j for 1 < i < Lj and 1 < j < s, thus we can 
robustly reconstruct N as an estimate of N when < < 1cm {61,62, - ■ ■ ,6s)- 

s Lj 



N 



1 



j=i i=i 



and 



\N -N\< 



(61) 



(62) 



Proof: The congruence system 



N = Uj^iMj^i + rj^i. 



where < rj^i < Mj,i for 1 < i < Lj, 1 < j < s and < iV < lcm{6i,62, 
following three-stage congruences. 



,6s), can be converted into the 
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For 1 < J < s, and Group j in the first stage, we can write 



In the second stage, 



0<Nj< 6j 



l<i< Lj. 



Pt = Ht,i5t,i + Nt,i 
0<Pt<^t 
l<i<yt 
l<t< k. 



(63) 



(64) 



Then, in the third stage, we can write 



(65) 



N = kit + Pt 

0< <lcm(a,--- ,ik) 
l<t<k. 

As long as we can accurately determine all of Kj^i, Ht-i and It in each congruence system, we can then 
accurately determine j. According to conditions (|60] |. we can accurately determine Kj^i for 1 < i < Lj, 
1 < j < s and get the error bound 

\Nj - Nj\ < Tj < min(Gj, rnin{Tt : 5j € {6t,i, ■■■ , T). 

Next, in each group of the second stage we take these estimates Nj as erroneous remainders and 6j as moduli. 
Applying the result of Corollary [T] we can accurately determine Ht^i, and also get the robust estimate Pt satisfying 



\Pt - Pt\ < min(Gj, mm{Tt : 6j € {6t,i, ■ 



Similarly, treat the estimates Pt as the erroneous remainders and as moduli in the third stage. Since \Pt—Pt\ < 
T, from Corollary [T] again, we can accurately determine It. Once we accurately determine these unknown folding 
numbers in each congruence system, we can accurately determine nj j and then obtain the robust estimate N of 
the unknown integer N. As for the error bound of the estimate N, the proof is the same to that of Theorem |2] 
Therefore, we complete the proof. ■ 

Example 6: Consider a given set of moduli {96 • 2, 96 • 3, 72 • 3, 72 • 5, 64 • 5, 64 • 7}. Treating them as one 
group and using the single robust CRT, we get its error bound r for the remainders satisfying r < 32/4. If we 
split the moduli to three groups: {96 • 2, 96 • 3}, {72 • 3, 72 • 5} and {64 • 5, 64 • 7}, we get d = 96/4, G2 = 72/4, 
= 64/4, <5i = 96 • 2 • 3, (52 = 72 • 3 • 5, (53 = 64 • 5 • 7 and G = 64/4. By using the two-stage robust CRT, we 
can get the error bounds r, for the remainders in Group j for j = 1, 2, 3 satisfying ti < min(Gi, G) = 64/4, 
T2 < min(G2,G') = 64/4 and < min(G3,G) = 64/4, all of which are larger than the bound 32/4 in the 
single robust CRT. If we use the three-stage robust CRT and split {61,82,63} to two groups again: {61,62} 
and {63}. We can get Ti = 72/4, T = 320/4. So, in this three-stage robust CRT, the error bounds satisfy 
n < min(Gi,Ti,T) = 72/4, T2 < min(G2,Ti,T) = 72/4 and T3 < min(G3,T) = 64/4. Compared with the 
two-stage robust CRT, we increase the robustness bounds in Group 1 and Group 2 from 64/4 to 72/4 by using 
the three-stage robust CRT. 
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The above three-stage robust CRT can be easily generalized to a multi-stage robust CRT with more than three 
stages. Although we can use a multi-stage robust CRT with some grouping methods to obtain a larger robustness 
bound for remainders in some groups, there are some challenges about how to choose moduli in a group and 
how many groups and stages we should split in order to find a better robustness bound such that we can enlarge 
aU the robustness bounds in every group. 

Let us first look at the simplest case when there are only three moduli {Mi, M2, M^}. Without loss of 
generality, we can assume that gcd(Mi,M2) > gcd(Mi,M3) > gcd(M2,M3). Regarding the three moduli as 
one group and by Corollary [1] the robustness bound is gcd (Mi, M3) /4. Since gcd (M3, M2) < gcd (M3, Mi), if 
we want to obtain a robustness bound strictly larger than gcd (Mi, M3) /4, the modulus M-^ must independently 
form an individual group by itself, and in the meantime it does not allow other groups to include M^. Thus, 
there is only one possible grouping method as {M^} and {Mi,M2}. The robustness bound therein is ri < 
gcd (M3, 1cm (Ml, M2)) /4 and T2 < min (gcd (Mi, M2) , gcd (M3, 1cm (Mi, M2))) /4, which may be both larger 
than gcd (Mi, M3) /4. Otherwise, we have to group them as {Mi, M^} and {Mi, M2} and in this way we may 
only enlarge one group's (not all group's) robustness bound as what is used in the proof of Corollary |6] 

Example 7: When Mi = 560, M2 = 480 and M3 = 210, we can see that gcd (Mi, M2) = gcd (560, 480) = 80, 
gcd (Ml, M3) = gcd (560, 210) = 70 and gcd (M2, M3) = gcd (480, 210) = 30. Regarding these three moduU as 
a single group, the robustness bound of the single stage robust CRT is gcd(Mi,M3) /4 = gcd (560, 210) /4 = 
70/4. In order to find a larger robustness bound, we just only consider the robustness bound of the case of two 
groups: {M3} and {Mi, A/2}- We can get n < 210/4 and T2 < 80/4, which are all larger than 70/4. 

The above special case is about only three moduli's grouping. When the number of given moduli is larger, it 
becomes more complicated. In the next section, we analyze some special cases. 

IV. An Algorithm for Grouping Moduli in Two-Stage Robust CRT 

From the above study, one may see that for a given set of moduli, although its determinable range for an integer 
from its remainders is fixed, i.e., the 1cm of all the moduli, the robustness bounds for an erroneous remainder 
and a reconstructed integer depend on a reconstruction algorithm from erroneous remainders, which depends on 
the grouping of the moduli in a multi-stage robust CRT. For a general set of moduli, it is not obvious on how 
to group them in a multi-stage (or even two-stage) robust CRT, in particular when the number of moduli is not 
small. In this section, based on Theorem [3] for the two-stage robust CRT, we propose an algorithm for grouping 
a general set of moduli to possibly obtain a larger robustness bound for remainders in every group than that in 
Corollary [T] for the single stage robust CRT. 

For a given set of moduli A4 = {Mi, M2, • • • , Ml}, L > 3, we first assume that the set of moduli does not 
include any pair of M^^ and Mi^ satisfying Mj^ = nMi^, because Corollary |2]has told us that such a redundant 
modulus Mj2 does not help to increase the determinable range of A^, < < lcm(Mi, M2, • • • , Ml) nor the 
robustness bound in a single stage robust CRT. From condition (l55l) we need to assure that all Gj in (1531 ) and G 
in (l54l ) after a grouping strictly greater than 6 = max min gcd(M.,M,) Corollary [T] for the single stage 

l<i<L l<jy^i<L 

robust CRT. Then, we have an algorithm as follows. 
1) For each Mi, 1 < i < L, find all Mj, I < j ^ i < L, satisfying g^dcy.Af.) ^ q ^.^j^ 
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corresponding set Mi'. 



gcd{Mj,Mi 



Thus, with each set A4i, we have 



. gcd(M„M,) ^ ^ 
Gj > mm > fc). 



If modulus Mi satisfies g^^^^^^-^^-) < e for all Mj,l<j^i<L, then we let Mi = {Mi}. 

2) Among all of the L sets Mi for 1 < « < L, there may be one or more pairs, Mi^ and Mi.^, satisfying 
■A^ii Q -^t2- Iri this case, we can delete the smaller set Mi-^ and only keep the larger set Mi.^. 

3) After Step 2), from the remaining sets of {Mi}, we find all such combinations of {Mi^, Mi^, ■ ■ ■ , A^i, } 

I 

that U Mi^ exactly includes all moduli M. In other words, if anyone Mi^ for 1 < s < Hs deleted from 

I 

a combination {Mi^^jMi^, ■ ■ ■ ,Mi,}, then [j Mi- is a proper subset of M, i.e., 

/ I 

U CXC|JX,^. (66) 

j=lkj^s j=l 

4) As for every combination in the above, treat each Mi. as a small group and calculate its 1cm as 6i^, 
I < j < I. Then, check whether 

gcd (6i , Si ) 

G = max mill - — ^ " > 6. (67) 

If there is one combination {Mi.} as above to make inequality ( [67l ) hold, then every min(Gj^ , G), 1 < j < /, 
is strictly greater than Q. According to (|55] ) in Theorem|3] one can see that this combination is just a grouping 
as desired and it enlarges a robustness bound for remainders in every group by using the two-stage robust 
CRT. Otherwise, if for every possible combination in Step 3), inequality (|67] ) does not hold, then it is said 
that we fail to use this algorithm to enlarge a robustness bound for remainders in every group by using the 
two-stage robust CRT. 

Let us first consider the above grouping algorithm for the case of |[T3l . i.e., the remaining factors Fj of the 
moduli Mi = MTi divided by their gcd M, 1 < i < L, are co-prime. First, we find all Mi = {Mi}, 1 < i < L. 
Next, there is only one combination {Mi, M2, ■ ■ ■ , Ml} satisfying (|66l ). and we treat each Mi = {Mi} as one 
group, then calculate G = M/4 in (|67] ). which equals to = M/4. In conclusion, we fail to find a grouping to 
enlarge a robustness bound for remainders in every group by using the two-stage robust CRT, which can be also 
confirmed from the earlier result in Corollary Next, we give a positive example. 

Example 8: Consider a set of moduU {210M, 143M, 77M, 128M, 81M, 125M, 169Af }, where M is an in- 
teger As one group, using the single stage robust CRT, its robustness bound is B = M/4. According to the 
above grouping algorithm, find 7 sets: Mi = {210M, 77M, 128M, 81M, 125M}, M2 = {143M, 77M, 169M}, 
M3 = {77M, 210M, 143M}, M4, = {128M,210M}, M5 = {81M,210M}, Mq = {125M,210M} and 
My = {169M, 143M}. Among them, there are only four combinations satisfying (l66l) as follows: {Mi, M2}, 
{Mi,M7}, {M2, Mi, M5, Me} and {M3, M4, M5, Mq, My}. Then, check whether one of the above four 
combinations satisfies inequality (l67l ). Fortunately, for the first combination {Mi, M2}, inequality (|67] ) holds. 
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We can calculate d = 2M/4, G2 = llM/4 and G = 7M/4, all of which are strictly greater than M/4. Thus, 
we have obtained a grouping method of the moduli to enlarge a robustness bound for remainders in every group 
by using the two-stage robust CRT. 

Remark 2: As one can see in the proof of Corollary |6] and in the above algorithm and examples, a modulus 
Mi may be repeatedly used in more than one groups in the two-stage robust CRT Its aim is to make G and 
Gj after grouping greater than or equal to the robustness bound by using the single stage robust CRT for the 
whole set of moduli. Recall the case of grouping a set of three moduli {Mi, M2, M3}. Assume gcd (Mi, M2) > 
gcd(Mi,M3) > gcd(M2,M3). From Corollary [1] the robustness bound for using the single robust CRT is 
gcd(Mi,M3) ^ j^QQQ^f^iYig to the above grouping moduli algorithm in two-stage robust CRT, they are split to two 
groups: {Mi,M2} and {M3}. One can see that Gi = E^^iMhMA^ G2 = Si = lcm(Mi,M2), 62 = 
M3 and G = In this grouping method, the robustness bound for remainders in group {Mi,M2} 

is min(Gi,G) and the robustness bound for remainders in group {M3} is min(G2,G'). As Gi and G2 are 
greater than ^^^(^^i'*^^) ^ ^ robustness bound for remainders in each group depends on the value of G. When 
G = §^^(^1'*^^) js less than g^^C^i'^'^a) ^ ^ robustness bound for remainders in each group is worse than that for the 
single robust CRT. Thus, we should repeat modulus Mi in group {A/3}, and the two groups become {Mi,M2} 
and {Ml, M3}. In this way, we enlarge a robustness bound for group {Mi, M2} and keep the robustness bound 
for group {Ml, M3} non-changed. On the other hand, when G = §^^(^1'*^^) larger than E^^!J^^hMll^ we do not 
need to repeat modulus Mi , since the robustness bound for group {Mi , M2 } and the robustness bound for group 
{M3} are both greater than g^^C^^i'^^-O ^ rpj^-^ example tells us that, to enlarge the robustness bound, whether a 
modulus Mi is repeatedly used or not in multiple groups depends on the grouping method and the set of moduli. 
Repeating a modulus, sometimes, may help to enlarge the robustness bound but sometimes may not. 

V. Simulations 

In this section, we present some simple simulation results to evaluate the proposed single stage robust CRT 
algorithm and the two-stage robust CRT algorithm for integers with a general set of moduli. Let us first consider 
the case when Mi = 9-15, M2 = 9-20 and M3 = 9-18. These three moduli do not satisfy the condition that F,, 
z = 1, 2, 3, are co-prime and thus the robust CRT obtained in |[T2| . |[T3l can not be applied directly. However, we 
can use our proposed single stage robust CRT. According to Corollary [T] the maximal range of the determinable 
A'^ is 1620 and the maximal remainder error level r for the robustness is upper bounded by r < ^ from (|27] i. 
In this simulation, the unknown integer is uniformly distributed in the interval [0, 1620). We consider the 
maximal remainder error levels t = 0,1, 2, 3, 4, 5, 6, and the errors are also uniformly distributed on [0, r] in the 
remainders. 2000000 trials for each of them are implemented. The mean error E{\N — N\) between the estimated 
iV in (IH) and the true A^ is plotted by the solid line marked with □, and the theoretical estimation error upper 
bound in Q is plotted by the solid line marked with A in Fig. [T] Obviously, one can see that for a general set 
of moduli the reconstruction errors of A^ from the erroneous remainders are small compared to the range of A^. 

Next, we compare the robustness between the single stage and the two-stage robust CRT algorithms for the 
above same set of moduli. In this case, the conditions of the maximal remainder error levels for the single stage 
and the two-stage robust CRT algorithms of two groups {Mi,M2} and {M3} are ^ and i.e., r < 6 and 
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11, respectively. Let us consider the maximal remainder error levels r from to 25, and 2000000 trials for each 
of them. The unknown integer N is taken as before. Fig. |2] shows the curves of the error bounds and the mean 
estimation errors E{\N — N\) for both the single stage and the two-stage robust CRT algorithms. Note that from 
our single stage robust CRT theory, the valid error bound for r is only upto 6, which can be seen from the 
simulation results that the mean estimation error E{\N — N\) starts to deviate the previous line trend at r = 7, 
then increases significantly and breaks the linear error bound when r is further greater, i.e., robust reconstruction 
may not hold. On the other hand, with the two-stage robust CRT algorithm, one can see that the curve of the 
mean estimation error E{\N — N\) is always below the curve of the error bound, i.e., we can robustly reconstruct 
A^, < < 1620, even when the maximal error level is 11 that is the upper bound for r obtained in this paper 
for the two-stage robust CRT algorithm. These simulation results confirm the theory obtained in this paper. 

VI. Conclusion 

In this paper, we considered the robust reconstruction problem from erroneous remainders, namely robust CRT 
problem, for a general set of moduli that may not satisfy the condition needed in the previous robust CRT studies 
in |[T2l . |[T3l . We obtained a necessary and sufficiency condition for the robust CRT when all the erroneous 
remainders are used together, called single stage robust CRT. Interestingly, our proposed single stage robust CRT 
may have better robustness than that of the robust CRT obtained in |[T2ll . |[T3l even when it could be applied. 
To further improve the robustness, we then proposed a multi-stage robust CRT, where the moduli are grouped 
into several groups. As an example, for the two-stage robust CRT, our proposed single stage robust CRT is first 
appUed to each group and then applied across the groups second time. Also, an algorithm on how to group a 
given set of moduli was proposed. We finally presented some simulations to verify our proposed theory. 
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Fig. 1. Mean estimation error and theoretical error bound using the single stage robust CRT 
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Fig. 2. Mean estimation error and theoretical eiTor bound comparison using the single stage robust CRT and the two-stage robust CRT 



